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EVENT DRIVEN MULTI-MEDIA COMMUNICATION MANAGEMENT SYSTEM 

Cross Reference to Related Applications 

The present application is a continuation in part of United States Patent 
5 Application 09/961 ,532 titled Teledata Space and Docking Station with Modular and 
Integrated Display filed on September 24. 2001, and is a continuation in part of 
United States Patent Application 10/002,542 filed on October 23, 2001, titled 
Modular Multi-Media Communication Management System, the contents of both 
such patent applications is incorporated herein. 

10 

Technical Field 

The present invention relates generally to managing multi-media 
communications, and more particularly to a modular system for integrating and 
coordinating a subscriber's communication needs. 

15 

Background of the Invention 

In today's fast paced business world, it is common for a person to rely on a 
combination of communication devices, such as: 6esk top telephones, mobile 
telephones, cellular telephones, fax machines, pagers, and the like, as well as 

20 enhanced communication services, such as: voice mail, e-mail, text messaging 
and the like to accommodate their communication needs. 

In an office environment, desk top telephone service, voice mail service, and 
fax service is typically provided by a private telephone communication system. A 
contemporary private telephone communication system consists of a switching 

25 network, a plurality of desk-top telephones, and a voice mail server. The voice mail 
"server is typically coupled to the switching network using a proprietary interface. 
Each desk top telephone and fax machine is coupled to the switching network by 
an extension line that consists of twisted pair conductors that are terminated by a 
telephone jack in the office. Communication between the desk-top telephone and 

30 the switching network over each extension line utilizes either proprietary digital 
signaling or plain old telephone service (POTS) signaling. The switching network is 
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further coupled to the public switched telephone network (PSTN) using trunk lines 
that are connected to a central office switch that is typically managed by the local 
telephone service provider. The switching network controls calls between 
extensions and between an extension and a remote destination via a trunk line 
5 coupled to the PSTN. The switching network also routes calls to the voice mail 
server when an extension remains unanswered, is busy, or Is othenA/ise 
programmed to route calls to voice mail. 

Recently fixed wireless networks have enabled wireless mobile telephones 
to be supported by the private telephone communication system. A wireless 

10 telephone controller is coupled to a wireless network in which a plurality of mobile 
telephones may be operated. The wireless telephone controller is coupled to the 
switching network of the private telephone communication system. In operation, 
each mobile telephone is assigned an extension number and calls directed to that 
extension are routed to the wireless telephone controller and then to the mobile 

15 telephone over the wireless network. Because the mobile telephone is equivalent 
to a desk-top telephone from the perspective of the private telephone 
communication system, full voice mail services are supported for the mobile 
telephone. 

E-mail service is typically provided by an e-mail service provider (either a 
20 private system or an independent Internet mail service provider). An e-mail client 
on the person's desk-top and/or notebook computer is typically used for sending 
and receiving e-mail over a data network connection to the e-mail service provider. 

Cellular service is provided by a cellular service provider. A cellular handset 
is used to place and receive cellular telephone calls within the cellular service 
25 provider's network. Additionally, the cellular service provider may offer a voice mail 
service which prompts callers to leave a voice mail in the event that the cellular 
handset is busy or remains unanswered after several rings. Similarly, pager 
services are provided by a paging service provider. A one-way (or two-way) pager 
may receive (and send) text messages within the paging service provider network. 
30 A problem associated with the above systems is that there is a lack of 

integration and coordination among the services. This lack of integration and 
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coordination causes a person to carry several devices with them as they do not 
know which telephone number a caller will choose to use. And, it causes a person 
to check multiple voice mail systems and e-mail systems frequently to avoid delays 
in returning calls or e-mails. 
5 Some of these problems can be eliminated, in theory, by vigilant use of call 

fonA/arding services to assure that incoming calls are fon^/arded, or funneled, to a 
single telephone that the person chooses to use at a particular time. However, call 
fOHA/arding is unworkable if call forward programming cannot be changed remotely 
and is still time consuming if programming can be performed remotely. 

10 Other advancements in voice mail server technology have addressed the 

need to frequently check multiple voice mail systems. For example, some voice 
mail servers send an audio file of a voice mail message to a specified e-mail 
address. This enables a person to retrieve voice mail messages through his or her 
e-mail client rather than dialing into the voice mail server. Additionally, some voice 

15 mail servers also initiate a call to a person's pager after a voice mail has been 
received to notify the person of a voice mail has arrived. 

While these advances have helped address the problems, they have not 
eliminated the need to have all such communication devices and the need to 
vigilantly check multiple systems for voice mail and/or e-mail messages throughout 

20 the day. 

What is needed is a multi media communication management system that 
allows for operator mobility that does not suffer the lack of integration and 
coordination of existing communication systems. 

Summary of the Invention 

25 The event driven multi-media communication management system 

comprises a controller that interfaces with a plurality of subscriber stations with their 
associated subscriber device(s) and with one or more communication medium 
service providers. The controller accesses subscriber directory information and 
automatically establishes a communication connection with a selected destination 

30 in response to the subscriber activating the associated subscriber device(s) or the 
subscriber station. 
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The controller translates multi-media communications received from a multi- 
media service provider into the protocols required for use by the subscriber stations 
as well as any conventional telephone stations that may be coupled to the 
controller. The communication and control signaling between the controller and the 
5 subscriber stations may be wireless in nature with the subscriber stations being 
powered by an internal battery and/or connection to a local source of conventional 
line voltage. 

The architecture of the subscriber station is modular. Multiple functional 
elements can be interconnected with backbone communication circuitry to form an 

10 integrated communication platform. Modular docking interfaces may be used to 
couple the subscriber station to portable subscriber devices and to enable 
integrated and coordinated communication through multiple communication 
medium service providers. This coordinated and integrated system architecture 
enables the subscriber station to merge the functionality and internal data of the 

15 various portable subscriber devices into the subscriber station, to direct the 
functionality and data of the subsccriber station to a selected one of the portable 
subscriber devices, and to provide the subscriber with a simple subscriber 
interface. 

The controller further associates multi-media communication directory 
20 information with each subscriber device to provide communication channels 
between a subscriber station and both other subscriber stations and remote 
destinations across the multi-media communication medium. 

For a better understanding of the present invention, together with other and 
further aspects thereof, reference is made to the following description, taken in 
25 conjunction with the accompanying drawings, and its scope will be pointed out in 
the appended clams. 

Brief Description of the Drawings 

Figure 1 is a block diagram view of a modular multi-media communication 
management system in accordance with one embodiment of the present invention; 
30 Figure 2 is a perspective exploded view of a modular subscriber station in 

accordance with one embodiment of the present invention; 
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Figure 3 is a block diagram of a subscriber station in accordance with one 
embodiment of the present invention; 

Figure 4a is a perspective view of a subscriber station in accordance with 
one embodiment of the present invention; 
5 Figure 4b is a view of a subscriber data assistant in accordance with one 

embodiment of the present invention; 

Figure 5 is a block diagram of a multi-media communication management 
system controller in accordance with one embodiment of the present invention; 

Figure 6 is a block diagram of various components of a multi-media 
10 communication management system in accordance with the present invention; 

Figure 7 is a block diagram of a subscriber data assistant in accordance with 
one embodiment of the present invention; 

Figure 8 is a block diagram of a wide area network communication device in 
accordance with one embodiment of the present invention; 
15 Figure 9 is a block diagram of a wireless dialog handset in accordance with 

one embodiment of the present invention; 

Figure 10a shows a table diagram representing an exemplary state of 
operation of a communication management system in accordance with one 
embodiment of the present invention; 
20 Figure 10b shows a table diagram representing an exemplary state of 

operation of a communication management system in accordance with one 
embodiment of the present invention; 

Figure 10c shows a table diagram representing an exemplary state of 
operation of a communication management system in accordance with one 
25 embodiment of the present invention; 

Figure lOd shows a table diagram representing an exemplary state of 
operation of a communication management system in accordance with one 
embodiment of the present invention; 

Figure lOe shows a table diagram representing an exemplary state of 
30 operation of a communication management system in accordance with one 
embodiment of the present invention; 



5 



13944.102 



Tel-003 



Figure 11 shows table diagrams representing exemplary states of operation 
of a subscriber station accordance with one embodiment of the present invention; 

Figure 12a shows table diagrams representing exemplary states of operation 
of a subscriber station accordance with one embodiment of the present invention; 
S and 

Figure 12b shows table diagrams representing exemplary states of operation 
of a subscriber station accordance with one embodiment of the present invention. 

Description of the Preferred Embodiments 

10 The present invention is now described in detail with reference to the 

drawings. In the drawings, each element with a reference number is similar to 
other elements with the same reference number independent of any letter 
designation following the reference number. In the text, a reference number with a 
specific letter designation following the reference number refers to the specific 

15 element with the number and letter designation and a reference number without a 
specific letter designation refers to all elements with the same reference number 
independent of any letter designation following the reference number in the 
drawings. A reference number followed by a "prime" symbol or a "double-prime" 
symbol represent an element that is a species embodiment of the more generic 

20 element designated by the reference number without a "prime" or "double-prime" 
designation. 

It should also be appreciated that many of the elements discussed in this 
specification may be implemented in hardware circuit(s), a processor executing 
software code, or a combination of a hardware circuit and a processor executing 
25 code. As such, the term circuit as used throughout this specification is intended to 
encompass a hardware circuit (whether discrete elements or an integrated circuit 
block), a processor executing code, or a combination of a hardware circuit and a 
processor executing code, or other combinations of the above known to those 
skilled in the art. 

30 Referring to Figure 1, an exemplary architecture of the multi-media 

communication management system 10 of the present invention is shown. The 
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multi-media communication management system 10 includes a control unit 12 that 
is coupled with a plurality of local communication devices 20 over a wireless local 
area network 22 (or by a wired network connection 23 to the backbone wired 
network of the wireless local area network 22). The local communication devices 
5 20 may include: subscriber stations 24, wireless dialog handsets 26, traditional 
telephone handsets 28. traditional fax machines 30 (both coupled through 
subscriber station 24), traditional computer systems 32, network printers 46, and 
various network appliances 34. 

In operation, the control unit 12 integrates and manages multi-media 

10 communication between the local communication devices 20 and between each 
local communication device 20 and a remote service provider (not shown) over the 
service provider's multi-media communication medium 18. More specifically, the 
control unit 12 translates received multi-media communication signals from the 
multi-media communication medium 18 (or a source local device 20) to the 

15 protocols required for use by the destination local communication device 20 (or the 
multi-media communication medium 18). 

The control unit 12 includes a multi-media communication service provider 
bay 14 which operatively couples one of a plurality of communication medium 
modules 16a-16d to the control unit 12. Each communication medium module 16a- 

20 16d is configured to interface with a service provider's multi-media communication 
medium 18a-18d. For purposes of illustration, communication module 16(a) may 
be a cable modem module for communicating over coaxial cable 36 with a multi- 
media communication service provider such as a local cable company, 
communication module 16(b) may be a wide area network radio for communication 

25 over a wireless spectrum channel 38 with a wide area wireless multi-media 
communication service provider such as an analog or digital cellular/PCS telephone 
service provider, communication module 16c may be a customer service unit (CSU) 
for communication over a T1 line 40 with a multi-media communication provider 
such as a local telephone service provider, and communication module 16d may be 

30 an optical modem for communication over a fiber channel 44 with a fiber optic multi- 
media communication service provider. It should be appreciated that the examples 
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of communication modules 16a-16d are for illustrative purposes only and it is 
recognized that multi-media communication services may be provided by other 
service providers utilizing other communication technologies such as satellite RF or 
other. For purposes of this invention, a communication module 16 includes circuitry 
5 for interfacing between the control unit 12 and a selected multi-media 
communication service provider. The control unit 12 further comprises a circuit 
switched provider bay 24 which operatively couples one or more public switched 
telephone network (PSTN) channels 42. 
Subscriber Station 

10 Referring to Figure 2, a perspective view of an exemplary subscriber station 

24 is shown. The subscriber station 24 includes a platform unit 52 that operatively 
couples to the control unit 12 via either a wireless communication link between a 
platform unit network circuit 96 and the wireless network 22 or a direct network 
connection 23 between the platform unit 52 and the backbone network of the 

15 wireless network 22. 

A plurality of functional modules 54, 56, 58, and 60 may be coupled to the 
platform unit 52 to form an integrated multi-media communication platform. The 
platform unit 52 includes a subscriber interface docking platform 64 for coupling 
and optionally supporting one of a plurality of modular subscriber interface units 60 

20 to the platform unit 52. The modular subscriber interface unit 60a may include a 
plurality of buttons 68 in an arrangement similar to a typical telephone key pad to 
provide for subscriber input in a manner similar to that of a traditional telephone 
handset. The modular subscriber interface 60b may include a liquid crystal touch 
panel display 72 to provide for subscriber input through virtual buttons visible 

25 thereon. 

The platform unit 52 further includes a first function specific docking platform 
74a and a second function specific docking platform 74b, each of which will couple 
to a plurality of function specific modules 54 and 56. The first function specific 
docking platform 74a is a shallow platform for coupling to function specific modules 
30 that primarily comprise function specific buttons or other circuits that may be placed 
within a thin module. The second function specific docking platform 74b is a larger 
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platform for coupling to function specific modules with more complex internal 

circuits requiring the additional size. 

In the exemplary embodiment, the function specific module 54 may include 

subscriber interface buttons configured for enhancing dialog communication 
5 through the subscriber station 24 such as an audio message control 76 for single 

button access to audio message files and dialog management controls 86 for single 

button control of enhanced dialog management functions. 

The function specific module 56 may include circuits configured for 

enhancing data communication through the subscriber station 24 such as an 
10 electronic message control 78 for single button access to subscriber electronic 

messages, a print control 80 for single button initiation of the printing of a 

subscriber electronic message file, and multiple data networking ports 84. 

The platform unit 52 further includes a docking bay 62 into which a modular 

docking interface 58 may be secured and operatively coupled to the platform unit 
15 52. The modular docking interface 58 supports one of a plurality of modular 

subscriber devices 50 within a subscriber device interface bay 66 and provides for 

operatively coupling the modular subscriber device 50 to the platform unit 52. The 

modular docking interface further includes a plurality of control buttons 92 for single 

button selection of functions indicated on a display 90 on the subscriber device 50. 
20 Exemplary configurations for the modular subscriber device 50 include a 

subscriber data assistant 86, a subscriber wide area network communication device 

88, and the wireless LAN dialog handset 26, each of which is discussed in more 

detail herein. 

While operatively coupled to the platform unit 52, the subscriber device 50 
25 becomes an integral part of the subscriber interface of the subscriber station 24. A 
liquid crystal display 90 on the subscriber device 50 may function to display multi- 
media communication management information under control of the platform unit 
52 and the control unit 12. Further, programmable subscriber controls 92 
positioned adjacent to the subscriber device 50 may be configured to activate 
30 platform unit 52 and control unit 12 functions in accordance with the contents of the 
display 90 adjacent to the controls 92. 
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The platform unit 52 may further include one or more of the following 
elements: a handset 98 similar to a traditional telephone handset to provide a 
subscriber voice interface, a speaker 100 and a microphone 102 to provide a 
hands-free subscriber voice interface, a modular battery pack 70 (which fits within a 
5 battery pack bay that is not shown) for operating power when the subscriber station 
24 is uncoupled from a line voltage, an on/off hook control button (or switch), and a 
help control button 104, a WAN control button 104, and a directory control button 
107, for single button selection of certain functions such as a help function, a wide 
area network communication function, display of a contact directory respectively. 

10 Figure 3 shows a block diagram of the subscriber station 24. The platform 

unit 52 Includes a controller 112 operating a packet voice application 113, a 
subscriber station application 115 (Figure 6), and applicable drivers for a plurality of 
peripheral controllers. The controller 112 is coupled to a local bus 116 that 
interconnects the application controller 112 with each of the plurality of peripheral 

15 controllers that include a wireless module 94, a power management controller 120, 
a communication controller 122, a network switch controller 124, a key switch 
controller 126, a touch panel controller 128, a plain old telephone service (POTS) 
converter 146, and a voice communication system 130. 

The wireless module 94 operatively couples the platform unit 52 with the 

20 control unit 12 over the wireless LAN 22 (both of Figure 1). The power 
management controller 120 selectively receives input power from the battery pack 
70 or external line voltage 134. The power management controller 120 includes 
appropriate circuits for converting the input power voltage to appropriate operating 
power required by each component of the subscriber station 24. Additionally, the 

25 power management controller 120 includes appropriate circuits for charging the 
battery pack 70 when the platform unit 52 is coupled to the line voltage 134 and 
generating appropriate power for operating and/or charging the modular docking 
interface 58 and the modular subscriber device 50 when coupled to the platform 
unit 52. 

30 The communication controller 122 operatively couples the modular docking 

interface 58 and the modular subscriber device 50 to the controller 112 such that 
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the platform 52 can exchange data with the modular subscriber device 50. In the 
exemplary embodiment, the communication controller is a serial communication 
controller that enables the serial exchange of data with a compatible serial 
communication controller within the modular subscriber device 50 over a physical 
5 medium. Exemplary physical mediums include hardwired contacts, an infrared 
transmission, and RF transmission, however other physical mediums are 
envisioned and the selection of a physical medium is not critical to this invention. 

The network switch controller 124 provides a network data port circuit which 
enables the controller 112 to communication with another network computing circuit 

10 over a network interface. The network switch controller 124 is coupled to a bus port 
135 within the function specific docking platform 74b for coupling to a mating port 
148 on the function specific module 56. 

The key switch (e.g. button) controller 126 is coupled to: a connector 136a 
which in turn is coupled to a mating connector on the modular subscriber interface 

15 unit 60a (Figure 2) for interconnecting the buttons 68 to the key switch controller 
126; a connector 136b which in turn is coupled to a mating connector 142 on the 
function specific module 54 for interconnecting the buttons 76 and 86 to the key 
switch controller 126; the bus port 135 which in turn is coupled to a mating port 148 
on the function specific module 56 for interconnecting the buttons 78 and 80 to the 

20 key switch controller 126; and the help control button 105, the WAN control button 
104, the directory button 107, and the on/off hook button (or switch) 109. In the 
exemplary embodiment, the key switch controller 126 may drive row and column 
signals to the various buttons and, upon detecting a short between a row and a 
column (e.g. button activation) reports the button activation to the controller 112 

25 over the bus 116. 

The touch panel controller 128 is coupled to a connector 144 which in turn is 
coupled to a mating connector on the modular subscriber interface unit 60b (Figure 
2) for interconnecting the touch panel 72 to the touch panel controller 128. In the 
exemplary embodiment, the touch panel controller 128 may include a separate 

30 display control circuit compatible with the resolution and color depth of the display 
of touch panel 72 and a separate touch panel control circuit for detecting subscriber 
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contact with the touch panel 72. 

The audio communication system 130 generates analog audio signals for 
driving the speaker 100 (or the speaker in the handset 98 of Figure 2) and detects 
input from the microphone 102 (or the microphone in the handset 98) under the 
5 control the packet voice application 113 operated by the controller 112. 

The POTS converter circuit 146 provides a standard POTS port signal (e.g. 
tip and ring) for operation of a traditional telephone or a traditional fax machine 
coupled to a POTS port 82 on the function specific module 56. In operation the 
POTS converter 146 circuit interfaces between the POTS signal and the application 
10 controller 112. 
Control Unit 

Figure 5 shows a block diagram of the control unit 12 in accordance with an 
exemplary embodiment of the present invention. As discussed previously, the 
control unit 12 includes a multi media communication service provider bay 14 which 

15 operatively couples one of a plurality of communication medium modules 16 to the 
control unit 12 for providing an interface to a service provider's multi-media 
communication medium. The control unit 12 further includes a local area network 
management system 214. a voice converter circuit 218, a voice server 226, a 
packet voice gateway 232, a session control server 230, messaging client 228, and 

20 a subscriber contact directory database 234. 

The local area network management system 214 manages the 
communication of data between the control unit 12 and each of the local 
communication devices 20 (Figure 1). The local area network management system 
226 may include an address server 220 for assigning a network address (from a 

25 block of available network addresses) to each local communication device 20 upon 
the local communication device subscribing to the wireless network 22 and 
requesting a network address. The local area network management system 214 
may also include a proxy server 222 for communicating with remote devices via the 
service provider multi-media communication medium 18 on behalf of each of the 

30 local communication devices 20. 

A port control circuit 216 may interconnect the local area network 

12 
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management system 214 to each of the wireless network 22, the packet voice 
^ gateway 232, the session control server 230, and the messaging client 228 over 
standard network port connections. 

The messaging client 228 provides for authenticating a subscriber to a 
5 remote messaging server (not shown) coupled to the service provider multi-media 
communication medium 18 and copying a plurality of subscriber messages from 
such messaging server. 

The voice server 226 provides audio prompts for providing a voice interface 
to accept an audio message for a subscriber, store the message as a digital file, 
10 and send the digital file to the remote messaging server associated with the 
subscriber. 

The session control server 230 operates the protocols for sending multi- 
media content messages and control messages to each local communication 
device 20 over the wireless local area network 22. In the exemplary embodiment, 

15 the communications between the session control server 230 and each local 
communication device occurs using tagged messages. The tag for each message 
identifies the content of the message to the recipient local communication device 
20. The packet voice gateway 232 operates provides real time voice 
communications between local communication devices 20 and between a local 

20 communication device 20 and a remote voice communication device over either the 
multi-media communication service provider medium 14 or the circuit switched 
channel 42. The packet voice gateway 232 includes a table 233 which affiliates 
each subscriber device 50 with the subscriber station 24 serving the subscriber 
device 50. 

25 The packet voice gateway 232 receives audio session signaling from each of 

the subscriber stations 24, the service provider medium 14, and the circuit switched 
channel 42 (via the voice converter 218) and established audio session signaling to 
destination network address in accordance with the table 233. After signaling an 
audio session channel is established between the packet voice gateway 232 and 

30 the subscriber station 24 and an audio session channel is established between the 
packet voice gateway 232 and the destination. The packet voice gateway 232 
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relays audio session communications between the two channels. 

The subscriber contact database 234 (Figure 6) includes a contact directory 
for each of a plurality of subscribers. Within each contact directory are a plurality of 
contact files that include basic information associated with the contact such as 
5 company name, telephone number, e-mail address, mailing address, fax number 
and the like. The contact directory 234 provides destination information which may 
be used by the packet voice gateway 232 and the session control server 230 for 
establishing communication channels from a subscriber station 24 to a selected 
contact. 

10 The voice converter 218 functions to convert audio signals compatible with 

the circuit switched channel 42 to packet voice signals compatible with the voice 
server 226 and the packet voice gateway 232 and, in reverse, functions to convert 
packet voice signals to audio signals compatible with the circuit switched channel 
42. Further, the voice converter 218 functions to convert a coded extension 

15 number (e.g. DID signal) that may be included within audio session signaling 
through the PSTN interface 24 to a digital format compatible with the packet voice 
gateway 232. Each of the local area network management system 214, the packet 
voice gateway 232, the voice converter 218. the voice server 226, the session 
control server 230, and the messaging client 228 operate as an integrated system 

20 under the control of the session control server 230. 
Subscriber Data Assistant 

Turning to Figure 7, exemplary structure of a subscriber data assistant 86 is 
shown. The subscriber data assistant 86 includes a controller 160 operating a 
communication subscriber station client application 174, a subscriber contact 

25 directory application 178 (Figure 6), and applicable drivers 176 for a plurality of 
peripheral controllers. The controller 160 is interconnected to the plurality of 
peripheral controllers by an internal bus 162. Because of the small size and the 
portability of the subscriber data assistant 86, the touch panel 90 provides the 
primary subscriber interface. The touch panel 90 is controlled by a display 

30 controller 164 and a touch panel controller 166. The display controller 164 drives 
the liquid crystal display of touch panel 90 using signals compatible with the 

14 
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resolution and color depth of the display 90. The touch panel controller 166 detects 
user activation of the touch panel 90. 

A communication controller 168 is also coupled to the bus 162 and operates 
under control of the application controller 160. In the exemplary embodiment, the 
5 communication controller 168 is a serial communication controller that is compatible 
with the communication controller 122 of the platform unit 52 (both of Figure 3) 
such that data communication may occur between the platform unit 52 and the 
subscriber data assistant 86 when the subscriber data assistant 86 is operatively 
coupled to the platform unit 52. 

10 A power management circuit 170 selectively receives input power from a 

battery pack 172 or from the power management circuit 120 in the platform unit 52. 
The power management circuit 170 includes appropriate circuits for converting the 
input power voltage to appropriate operating power required by each component of 
the subscriber data assistant 86. Additionally, the power management circuit 170 

15 includes appropriate circuits for managing charging of the battery pack 172 when 
subscriber data assistant 86 is coupled to the platform unit 52. 

The communication subscriber station client application 174 provides for 
displaying multi-media communication management information under control the 
platform unit 52 when coupled to the platform unit 52. In the exemplary 

20 embodiment the communication subscriber station client application 174 receives 
content messages and control messages from the platform unit 52 in the form of 
tagged messages. After receipt of the tagged messages, the communication 
subscriber station client application 174 builds a display document to display the 
communication management information represented by tagged content messages 

25 in accordance with display layout control messages that are compatible with the 
size, resolution, and color depth of the touch panel display 90. The display 
document is then displayed on the touch panel display 90. 

The subscriber contact directory application 178 (Figure 6) maintains a 
contact directory file for each of a plurality of subscriber contacts 57 as shown in 

30 Figure 4b. The application 178 also may permit the subscriber to add contact 
information and edit contact information through the touch panel 90 when the 
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subscriber data assistant 86 is uncoupled from a subscriber station 24. 

It should be appreciated that in additional to operating the drivers 176. the 
communication subscriber station client application 174, and the subscriber contact 
directory application 178, the controller 160 may optionally operate any of the other 
5 software applications that are commercially available for portable data assistants 
(PDAs). While operation of such PDA applications may be useful to the subscriber, 
it is not critical to the operation of the present invention. 
Subscriber Wide Area Network Communication Device 

Turning to Figure 8. exemplary structure of a subscriber wide area network 

10 communication device 88 is shown. The wide area network communication device 
88 includes a controller 180 operating a communication subscriber station 
application 198, the subscriber contact directory application 178, a wireless 
communication application 194, and applicable drivers 196 for a plurality of 
peripheral controllers. The controller 180 is interconnected to the plurality of 

15 peripheral controllers by an internal bus 186. The peripheral controllers include a 
wide area network RF circuit 182, a voice system 197, a display controller 184, a 
touch panel controller 185, a key switch controller 193, a communication controller 
188. and a power management system 1 90. 

The wide area network RF circuit 182 may be a circuit for transmitting and 

20 receiving signals from a wide area network service provider's medium under control 
of the wireless communication application 194. Exemplary wide area network 
service provider mediums include an analog or digital cellular or PCS telephone RF 
system. 

The key switch controller 193 is coupled to the control buttons 195. The key 
25 switch controller 193 drives row and column signals to the control buttons 195 and, 
upon detecting a short between a row and a column indicating button activation, 
reports the activation to the controller 180. The control buttons 195 may be used 
by a subscriber for operating the wide area network communication device 88 when 
uncoupled form the platform unit 52. 
30 The voice system 197 includes a speaker and a microphone. Under control 

of the wireless communication application 194, the voice system 197 may provide a 

16 
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subscriber voice interface for an audio session with a remote device over the wide 
area network service provider's medium. 

The display controller 184 drives the display 90 using signals compatible 
with the resolution and color depth of the display 90. The display 90 may optionally 
5 be a touch panel display 90 and the touch panel controller 185 detects user 
activation of the touch panel 90. 

The communication controller 188 may be a serial communication controller 
compatible with the communication controller 122 in the platform unit 52 such that 
data communication may occur between the platform unit 52 and the wide area 

10 network communication device 88 when the wide area network communication 
device is operatively coupled to the platform unit 52. 

The power management controller 190 operating with a battery pack 192, 
both of which may operate in a similar manner to the power management controller 
170, and the battery pack 172 discussed with reference to Figure 7. 

15 Similar to the subscriber data assistant 86 (Figure 7), when the wide area 

network communication device 88 is coupled to the platform unit 52, the 
communication subscriber station application 198 provides for displaying multi- 
media communication management information under control the platform unit 52 
and provides for multi-media communication directly between the platform unit and 

20 the wide area network service provider medium. 

In addition the communication subscriber station application 198 may 
receive messages from the platform unit 52 which may be multi-media 
communication messages for communication over the wide area network service 
provider medium. Each message includes a tag that identifies the contents of the 

25 message. After receipt of a tagged message, the communication subscriber station 
application 198 may identify whether the message is for communication with the 
wide area network service provider medium or whether it is multi-media 
communication management information for display. 

When the message is for communication with the wide area network service 

30 provider medium, the communication subscriber station application 198 will 
reformat the message to a format compatible with wide area network service 



13944.102 Tel-003 

provider medium transmission standards and transmit the message using tlie wide 
area network RF circuit 182. 

The wide area network communication device 88 may also receive signals 
from the wide area network service provider medium via the wide area network RF 
5 circuit 182. When received, the communication subscriber station application 198 
reformats the messages into a plurality of tagged messages for communication to 
the platform unit 52 and sends the tagged messages to the platform unit 52 via the 
communication controller 188. 
Wireless Voice Handsets 

10 Figure 9 shows a block diagram of an exemplary wireless dialog handset 26. 

The wireless voice handset 26 includes a network circuit 278 and a controller 250 
that operates a communication subscriber station application 256, the subscriber 
contact directory application 178 (Figure 6), a LAN communication application 252, 
and applicable drivers 254 for each of a plurality of peripheral controllers. The 

15 controller 250 is interconnected by a bus 276 to the plurality of peripheral 
controllers which include a module controller 258, a display driver 260, a touch 
panel driver 261 , a key switch controller 264, and a power management circuit 270. 

The module controller 258 operatively couples the network circuit 278 to the 
20 controller 250 such that the wireless voice handset 26 may communicate with the 
control unit 12 over the wireless LAN 22 (both of Figure 1). In the exemplary 
embodiment, the module controller 258 may be a PCMCIA controller circuit and the 
network circuit 278 is configured as a PCMCIA card that coupled to the module 
controller 258 through a PCMCIA connector 272. The LAN communication 
25 application 252 operates the network circuit 278 for communicating with the control 
* unit 12 using appropriate wireless signaling protocols. 

The key switch controller 264 is coupled to the control buttons 266. The key 
switch controller 264 drives row and column signals to the control buttons 266 and, 
upon detecting a short between a row and a column indicating button activation, 
30 reports the activation to the controller 250. The control buttons may be used by a 
subscriber for operating the wireless voice handset 26 when uncoupled form the 
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platform unit 52. 

The display controller 260 drives the display 90 (optionally a touch panel 
display 90) using signals compatible with the resolution and color depth of the 
display 90. The touch panel controller 261 detects user activation of the touch 
5 panel display 90. The power management controller 270 operates in conjunction 
with a battery pack 268, both of which may operate in a similar manner to the 
power management controller 170, and the battery pack 172 discussed with 
reference to Figure 7. 

When the wireless voice handset 26 is coupled to the platform unit 52, the 

10 communication subscriber station application 256 provides for displaying multi- 
media communication management information under control the platform unit 52. 
Additionally, the communication subscriber station application 174" may receive 
multi-media communication management information content messages and 
control messages directly from the control unit 12 via the wireless network 22. After 

15 receipt of the tagged messages from either the platform unit 52 or the control unit 
12, the communication subscriber station application 174" builds a document to 
display the communication management information represented by the tagged 
content messages in accordance with display layout control messages that are 
compatible with the size, resolution, and color depth of the touch panel display 90. 

20 The display document is then displayed on the touch panel display 90. 
Session Control Server 

Referring to Figure 4 in conjunction with the tables of Figures 10a-10e, 
exemplary operation of the session management server 230 providing multi-media 
communication management in accordance with the present invention is shown. 

25 The session control server 230 operates as a multi-tasking event driven 

state machine. A separate state machine is operated by the session control server 
230 for each of the local communication devices 20 (Figure 1). During operation of 
each state machine, the session control server 230 receives event signals from 
each of the voice server 218, the messaging client 228, the packet switched voice 

30 gateway 232. the multimedia communication service provider medium 18, and the 
particular local communication device 20 for which the state machine is operated. 

19 
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Each state machine includes multiple processing states and within each processing 
state there is a plurality of events that may be detected by the session control 
server 230. Each event has a processing state dependent processing sequence 
that is processed by the session control server 230. 
5 The table of Figure 10a represents a start up state. In the start up state, the 

session control server 230 is waiting for an open session request from a new 
subscriber device 24 on a predetermine port. When a subscriber station 24 has 
just operatively coupled to the local area network 22, obtained a network address 
from the network address server 220, and is ready to operate, it is programmed to 

10 send an open session request to a predetermined network address (matching that 
of the session control server 230) on the predetermined port. Event 300 represents 
receipt of an open session request from the subscriber station 24. In response, 
various steps are performed to initiate management of multi-media communications 
of the subscriber station 24 that include: providing logon scripts to the subscriber 

15 station 24; obtaining an interface configuration of the subscriber station 24; 
providing main menu display content and main menu layout control messages to 
the subscriber station 24 that are compatible with the particular display (if any) that 
is included in the interface configuration of the subscriber station 24; and 
transitioning to a main menu state 304 as represented by Figure 10b. 

20 When in the main menu state 304, the session control server 230 is waiting 

for one of a plurality of events to occur that may include event 302 that represents a 
message indicating subscriber selection of a menu choice from the main menu, 
event 308 that represents a message from the subscriber station 24 indicating that 
a subscriber device 50 (Figure 1 ) has been operatively coupled to, and is ready to 

25 be served by, the subscriber station 24, and event 310 that represents a message 
indicating subscriber activation of the help control 105 (Figure 2). 

In response to event 302, the session control server 230 transitions to a 
state corresponding to the selected menu choice. In response to event 308, the 
session control server performs a plurality of steps to associate the subscriber 

30 device 50 with the subscriber station 24. Messages representing extraction control 
scripts may be sent to the subscriber station 24 which provide for the subscriber 

20 
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station to obtain identification information associated with the subscriber device 50 
and send the identification information to the session control server 230. Messages 
are received from the subscriber device 50 to provide for receiving subscriber 
contact files 178 (Figure 6) to update the subscriber contact directory database 234 
5 (Figure 6) with any edits to the subscriber contact files that may have been made 
when the subscriber device 50 was uncoupled form the subscriber station 24. 
Subscriber contact information from the subscriber contact directory 234 may be 
communicated to the subscriber device 50 to update the subscriber contact files 
stored on the subscriber device 50. Main menu display content messages and 

10 main menu display layout control messages that are compatible with display 90 on 
the particular subscriber device 50 are sent to the subscriber station 24 to effect the 
display of a main menu on the display 90. Following completion of these steps, the 
session control server 230 transitions to a subscriber device main menu state 316 
as represented by Figure 10c. 

15 In response to event 310, the session control server 230 provides control 

scripts to the subscriber station 24 to provide for the subscriber station 24 to 
establish the appropriate audio session channels to the voice gateway 232 and for 
the voice gateway 232 to access the session control server 230 through the voice 
converter 218, and transitions to an audio help state wherein a subscriber is 

20 directed through a sequence of help menu choices by audio prompts initiated by 
the session control server 230. 

When in the subscriber device main menu state 316 of Figure 10c, the 
session control server 230 is waiting for one of the events associated with the 
subscriber device main menu state 316 that include event 312 that represents a 

25 message indicating subscriber selection of a menu choice from the subscriber 
device main menu, event 320 that represents a message indicating subscriber 
activation of the help control 104 (Figure 2), event 322 that represents a message 
indicating subscriber activation of the message control 78 (Figure 2), event 324 that 
represents a message indicating subscriber activation of the audio message control 

30 76 (Figure 2), event 314 that represents a message indicating subscriber activation 
of the directory control (Figure 2), and event 326 that represents a message 

21 
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indicating that the subscriber device 50 is not longer served by the subscriber 
station 24. 

In response to event 312, the session control server 230 transitions to a 
state corresponding to the selected menu choice. In response to event 320, the 
5 session control server 230 provides messages representing help menu display 
content and help menu display layout control in accordance with the parameters of 
the display 90 on the subscriber device 50 and then transitions to a graphic help 
state wherein the subscriber is directed through a sequence of graphic help menu 
choices through various levels of display menus provided to the subscriber station 

10 24 through help menu display content messages and help menu display layout 
control messages. In response to events 322 or 324 the session control server 230 
obtains messages associated with the subscriber device from a remote messaging 
server coupled to the service provider medium, sorts the messages in accordance 
with the message type selection, provides messages representing message list 

15 display content and message list display layout control in accordance with the 
parameters of the display 90 on the subscriber device 50, and then transition to a 
message list state 328 (Figure 10d). In response to event 314 the session control 
server 230 obtains subscriber contact information that corresponds with the 
subscriber device, provides the directory content and display layout control 

20 messages to the subscriber station 24, and transition to a subscriber directory state 
370 as represented by the table of Figure 10e. In response to event 326 the 
control unit transitions to the main menu state 304 (Figure 10b). 

When in the message list state 328 of Figure 10, the session control server 
230 is waiting for one of a plurality of events associated with the message list state 

25 328 that include event 334 that represents a message indicating that the subscriber 
has activated a control to obtain an audio message from the list (either by touch 
panel activation or by buttons 92 of Figure 2), event 336 that represents a message 
indicating that the subscriber has activated a control to display a message from the 
list (either by touch panel activation of by buttons 92 of Figure 2), event 338 

30 representing a message indicating that the subscriber has activated the print 
control 80 (Figure 2), event 340 that represents a message indicating subscriber 
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activation of the help control 105 (Figure 2), and event 342 that represents a 
message indicating that the subscriber device 50 is not longer served by the 
subscriber station 24. 

In response to event 334 the session control server 230 connmunicates the 
5 selected audio message files to the subscriber station 24 and provides control 
scripts to the subscriber station 24 to provide for the subscriber station to output the 
message through the voice system 130. In response to event 336 the session 
control server 230 provides display content and display layout control that are 
compatible with parameters of the display 90 on the subscriber device 50 for 

10 display of the selected message and then transitions to a message display state. 
In response to event 338, the session control server 230 formats the selected 
message into a printer compatible file, send the print file to a printer coupled to the 
network 22, and return to the message list state 328. In response to event 340 the 
session control server 230 provides messages help menu display content and help 

15 menu display layout control messages in accordance with the parameters of the 
display 90 on the subscriber device 50 and then transitions to the graphic help 
state. In response to event 342 the control unit transitions to the main menu state 
(Figure 10b). 

When in the subscriber directory state 370 (Figure 8e) the session control 
20 server 230 is waiting for an event associated with the subscriber directory state 370 
which may include event 372 that represents receipt of a message representing a 
contact selection that indicates that either an applicable portion of the touch panel 
was activated or a particular button 92 (Figure 2) was activated to indicate 
subscriber selection of a contact, event 374 that represents receipt of a message 
25 that indicates subscriber activation of the help control 105 (Figure 2), and event 378 
that represents a message indicating that the subscriber device 50 is no longer 
served by the subscriber station 24. 

In response to event 372, the session control manager 230 communicates a 
control script to the subscriber station 24 that provides for the subscriber station 24 
30 to establish the appropriate audio session channels to the voice gateway 232 and 
for the voice gateway 232 to establish an appropriate audio session channel to a 
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destination associated with tfie selected contact. The control script may include a 
telephone number from the subscriber contact directory database 234 (Figure 6) 
associated with the contact. Following communication of the control script, the 
session control server 230 transitions to an audio session state. 
5 In response to event 374, the session control server 230 provides messages 

representing help menu display content and layout control and then transition to the 
graphic help state. In response to event 378, the session control server 230 
transitions to the main menu state 304. 
Communication Subscriber Station Application 

10 Turning to Figure 6, in the exemplary embodiment, the communication 

subscriber station application 115 is an event driven state machine. Within each 
processing state various events that are generated by one of the peripheral circuits 
may be detected by the communication subscriber station application 115 and, 
upon detecting an event, a certain string of processing steps that correspond to the 

15 particular event is performed by the communication subscriber station application 
115. 

Referring to the tables of Figure 1 1 in conjunction with the block diagram of 
Figures 3 and 6, exemplary operational states of the communication subscriber 
station application 115 are shown. The start up state 346 represents the state of 

20 operation of the subscriber station 24 immediately after establishing a network 
connection with the control unit 22 via the network 22. Upon establishing a 
connection, event 366, the communication subscriber station application 115 
initiates a session request to the session control server 230 on a predetermined 
port. Event 368 represents confirmation of the session from the session control 

25 server 230 and receipt of the logon script from the session control server 230. In 
response to event 368, the subscriber device processes the script which may 
include detecting the interface configuration of the subscriber device 24, providing 
the interface configuration to the session control server 230, and transitioning to the 
base state 344. 

30 The base state 334 represents the communication subscriber station 

application 1 15 waiting for an event signal from one of the peripheral devices which 

24 
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may include event 354 that represents subscriber touch panel activation, event 356 
that represents subscriber activation of one of the control buttons, event 358 that 
represents receipt of display content and display layout control messages from the 
controller 12, event 360 that represents receipt of a message comprising a 
5 processing script from the controller 12, event 362 that represents a wide area 
network telephone signal through a wide area network subscriber device 88 (Figure 
1), event 364 that represents detecting a subscriber device 50 being coupled to the 
subscriber station 24, event 350 that represents receipt of a message from the 
controller 12 directed to the subscriber device 50, and event 352 that represents 

10 receipt of a message from the subscriber device 50 directed to the controller 1 2. 

In response to event 356, the application 115 provides a message indicating 
the touch panel activation event to the session control server 230. In response to 
event 358, the application 115 provides a message indicating activation of the 
particular control button to both the packet voice application 113 and the session 

15 control server 230. In response to event 358, the application 115 either updates 
the display 72 on the touch panel unit 60b (both of Figure 2) via the touch panel 
controller 128 or provides the messages representing the display content and the 
display layout control to the subscriber device 50 via the communication controller 
122 for the subscriber device 50 to update its own display. In response to event 

20 360, the subscriber device processes the script as provided including interfacing 
with any of the peripheral devices as required by the script. For example, the 
extraction control script received from the session control server 230 may require 
interrogating the subscriber device for identity information and providing a message 
representing such identification information to the session control server 230. In 

25 response to event 362, the subscriber device may enter a wide area network 
communication state wherein it relays a digital representation of voice signals 
between the dialog system 130 and a wide area network subscriber device 88 such 
that a voice conversation may take through the wide are network. In response to 
event 364, the subscriber device 24 may send a message indicating that a 

30 subscriber device 50 is being initialized by the subscriber station 24 (which 
corresponds to event 308 of Figure 10b) and then return to the base state 344. In 

25 
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response to event 350, the application 115 provides the messages to the 
subscriber device 50 via the communication controller 122. In response to event 
352, the application 115 provides the messages to the session control server 230 
via the network. 
5 Packet Voice Application 

The packet voice application also operates as an event driven state 
machine. Again, each state includes a plurality of events that may occur when 
operating in the state and a sequence of steps that the packet voice application 
processes in response to the event. Referring to the tables of Figures 10a and 10b 

10 in conjunction with the block diagram of Figure 3, exemplary operational states of 
the packet voice application 1 13 are shown. 

The standby state 380 represents the packet voice application in an inactive 
mode waiting for an event that may include event 388 which represents receipt of 
an audio session set up signal from the packet voice gateway 232, event 390 that 

15 represents receipt of a message from the communication subscriber station 
application 115 that represents activation of the on/off hook button (or switch) 109, 
and event 392 that represents receipt of a message from the communication 
subscriber station application 115 instructing the packet voice application to set up 
an audio session with a specified destination. 

20 In response to event 388, the packet voice application transitions to a call 

signaling state 382 and reports the transition to the communication subscriber 
station application 115. In response to event 390, the packet voice application 113 
transitions to an off hook state 384 and reports the transition to the communication 
subscriber station application 115. In response to event 392, the packet voice 

25 application sends applicable call signaling messages to the packet voice gateway 
232 to set up the audio session channel with the voice gateway 232 and provides 
for the voice gateway 232 to set up an appropriate audio session channel with the 
destination. The packet voice application then transitions to the call signaling state 
382, and reports the transition to the communication subscriber station application 

30 115. 

When in the call signaling state 382, the packet voice application is providing 

26 



13944.102 Tel-003 

a ring signal to the subscriber as either a ring signal to notify the subscriber of an 
incoming audio session or to notify the subscriber that an audio session set up 
signal has been sent to the packet voice gateway 232 and a destination device is 
"ringing" waiting for a remote party to effectively answer the call. During the ringing 
5 state 382 the packet voice application may detect events such as event 394 that 
represents receipt of a message that represents activation of the on/off hook button 
109 (Figure 2), event 396 that represents termination of call signaling by the packet 
voice gateway 232, event 398 that represents receipt of a ready for audio session 
signal from the packet voice gateway 232 if the packet voice application 1 1 3 is 

10 ringing to notify the subscriber that a remote device is ringing. 

In response to either event 394 (and event 396 if the subscriber station 24 is 
currently off hook), the packet voice application returns to the standby state 380 
and report the state transition to the communication subscriber station application 
115. In response to event 398 (and event 396 if the subscriber station 24 is current 

15 on hook) the packet voice application transitions to an audio session state 386 and 
report the transition to the communication subscriber station application 115. 

When in the off hook state 384, the packet voice application may be 
generating a dial tone through the voice system 130 as a prompt for the subscriber 
to use the keypad to enter a telephone number. During the off hook state 384, the 

20 packet voice application 113 may accept events such as event 400 that represents 
receipt of a message that represents key pad activation, event 402 that represents 
validation of a number sequence as a complete telephone number that can be used 
to set up an audio session, and event 404 that represents receipt of a message that 
represents activation of the on/off hook button 109 (Figure 2). 

25 In response event 400 the packet voice application 113 generates a DTMF 

tone through the voice system 130 to provide the subscriber with audio feedback 
and stores the numeral as part of the sequence for validation. In response to event 
402, the packet voice application initiates call signaling to the packet voice gateway 
232 utilizing the validated number as the destination, transitions to the call signaling 

30 state 382, and reports the transition to the communication subscriber station 
application 115. In response to event 404, the packet voice application 113 
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transitions to the standby state 380 and reports the transition to the communication 
subscriber station application 115. 

When in the audio session state 386 the packet voice application 113 is 
relaying messages representing a real time audio dialog between the voice system 
5 130 and the packet voice gateway 232. When in the audio session state 386, the 
packet voice application 113 may accept events such as event 406 that represents 
termination of the audio session by the packet voice gateway 232, event 408 that 
represents receipt of a message that represents subscriber activation of a keypad 
numeral, and event 410 that represents receipt of a message that represents 

10 activation of the on/off hook button 109 (Figure 2). 

In response to event 406, the packet voice application 113 returns to the off 
hook state and reports the transition to the communication subscriber station 
application. In response to event 408, the packet voice application 113 generates a 
DTMF tone in the audio session signals to the packet voice gateway 232. In 

15 response to event 410, the packet voice application 113 returns to the stand by 
state 380 and reports the state transition to the communication subscriber station 
application 115. 

It should be appreciated that the systems and methods of the present 
invention provide for the communication and control of multi-media messages by a 

20 central control unit and a plurality of subscriber stations operating under the control 
of the control unit. This coordinated and integrated system architecture enables the 
subscriber station to merge the functionality and internal data of various portable 
subscriber devices into the subscriber station, to direct the functionality and data of 
the subscriber station to a selected one of the portable subscriber devices, and to 

25 provide the subscriber with a simple subscriber interface. 

Although the invention has been shown and described with respect to 
certain preferred embodiments, it is obvious that equivalents and modifications will 
occur to others skilled in the art upon the reading and understanding of the 
specification. For example, the above described processing states, events, and 

30 processing steps for both the subscriber station 42 and the session control server 
230 are exemplary states only for demonstrating operation and are not intended to 
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limit tlie scope of the present invention. It is envisioned that after reading and 
^ understanding the present invention those skilled in the art may envision other 
processing states, events, and processing steps to further the objectives of the 
modular multi-media communication management system of the present invention. 
5 The present invention includes all such equivalents and modifications, and is 
limited only by the scope of the following claims. 
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